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ABSTRACT 

Many different taohnigues hava been used to increase 
response rates to survays. In this study, Federal Express overnight 
serviee was used to test the effectiveness of express mail in 
stimulating response to a mail survey of 132 physicians. The sample 
was randomly split into two groups. One group received the initial 
mailing by Federal Express while the other group received the survey 
by regular first class mail* The average cost per complete survey for 
Federal Express was 127.07, and for first class mail $21^63. Although 
Federal Express was more expensive^ the results showed that tha 
Faderal Express mailing achieved a higher response rate and that 
people responded faster to the survey delivered by Faderal Express. 
(JAZ) 
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THE ffFECTIVENKS OF E)PRESS MAIL AS A RES^OheE STIMULATOR 
IN MAIL SURVEVS OF DIFFICULT POPU».ATIOlsB 



John F. Anderaorii Marsha A, Nfebuhr, and G^reg S, Gum 
AndarsMjNiebuhr & Associates^ Ir^ma, 



Man/ different technlquas have been used to Increoise response rates to 
surveys- In this stud/5 Federal Express overnight deli^^ery service was used 
to test the effectiveness ofiKpress moil In stimuIatiTng response to a mall 
survey of 132 physicians. The sample was randomly ^plit Into two groups. 
One group received the initial mailing via Federal Ej^press while thi other 
group received the inlfial mailing by regular first ^loss mail. Although 
Federal Express moil was mm expensive than first »eigs$ moil (x -$27,07 
vs^ X = $2l,fi3 per complata iurvey)| findings indjc^^^ate that the Fedtral 
Express mailing achieved a higher response rate (X^ m 5.13^ p<*05) and that 
people responded faster to the survey (t ^ 3.55, p<',,OI) than did the first 
class mail group* 



INTRODUCTION 



The success of any survey end the usefulness af the results produced can only ba 
assured If the results obtained ere truly representative mnd accurately reflect the 
relevant characteristics of the people being surveyed, M^ny problems can interfera 
with the accuracy of survey resultsi Such problems include sampling error, reliability 
and validity problems resulting from poorly constructed questionnaire items, and 
nonresponse bios- 

Nonresponse bias Is one of the most significant, widely^ dlscussedj and overlooked 
problems facing users of survey reiearch. It is significant be-^ause survey results based 
on low response rates cannot be assumed to be accurate qdC representative (20). It Is 
all too commonly overlooked becauie achieving a high res^ponse rate Is believed by 
many people to be either Impossibia, too expensive^ or prol — libitlvely time consuming. 



Therefore, many researchers have chosen to ignore the problem. Survey responis 
rates of only 50, 40, 30, or even as low as 20 percent are comnnonplaGe, A recent 
survey conducttd by a professor at a mirfwestern college obtained a response rote of 
only 33 percent which the professor said was "phenomenal" (19). What is truly 
phenomenal is that such studies are j^^blished, believed, and are not challengid 
methodologicg||y» 

Mail survayi are frequently criticia^'^d because of low response rates. However, 
mail surveys continge to be an important and widely used data collection method. In 
spite of reeent advances in telephone aur-vey methods including technological innova- 
tions such as computer assisted telephone Interviewing (CATI) and random digit dialing 
techniques, mdl surveys have not beeft forgotten. In fact, moil survey methods 
continue to be widely used and may become even more popular if state legislatures 
begin to enact laws protecting people's "telephone privacy" by limiting accass to 
people by telephone. Such legislation is cL^rrently under serious study in many states. 

Mail surveys ore an Important F^iethodological tool to reach people with 
nonpublished talephone numbers and to stjrvey groups who are difficult to reach by 
telephone because their lifestyle patterns ^r their Jobs which do not keep them in closi 
proximity to a tilaphone. 

To usa mall surveys effectively, the researcher must be prepared to address the 
danger of nonresponse bias and must do everything possible to obtain cooperation from 
potential respondents. This means the rfeaearcher must be prepared to draw upon a 
variety of techniques known to stimulate response rates and select those which will be 
most effective with the population being studied (2). 

A great deal of research has been conducted to study the effect of a wide 
variety of vorioblis in increasing respor^Be rates to mail surveys. Some common 
examples include the use of preletters other precontacts (4, 9, 13, 17), various 
incentives (3, 10,18, 22), diverse types of F^IIow-up reminders (I, 7), personalization (5, 
6, 8| 14), and vaHations in the type of postage used (II, 12, 15, IS, 21) to name only a 
few, 
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A relatively recent development in mailing processes is the availability of 
various "express mail" services* Express mail Is a faster and more reliable alternative 
to conventional first class mail. Of course, it is also more expensivei howeveri the 
increased cost must be weighed against the potential benefit of higher response ratej 
deoreased time required to obtain cooperation, and increased Initial Impact of the 
mailing on populations who are inundated with conventional mall* 

Th»s study was undertaken to test the effectiveness of express mail in stlm- 
ulaflng responses to a survey mailed to physicians who are a population from whom 
cooperation in surveys is notoriously difficult to obtain. Specific hypotheses being 
tested werei 

(1) Mailing surveys via Federal Express will result In higher response rates 
than moiling via first cla^ mail* 

(2) Mailing surveys via Federal Express will produce a given response rate 
faster than mailing via first class mall, 

(3) Mailing surveys via Federal Express will cost no more to achieve a given 
response rate than mailing via first class mail* 

METHOD 

To examine the effects of using express mail services to send mall questionnaires 
to physicians, an experiment was conducted In conjunction with a survey conducted for 
a large hospital* The questionnaire dealt with physicians' opinions and experiences 
related to oncology and in-service educational opportunities. 

Surveys were mailed to a sample of 132 physicians. These physicians were 
located throughout the state of Minnesota and eastern Wisconsin, 

To test the effects of mailing via express mall, the sample was randomly split 
Into two groups* One group (5^65) received the initial cover letter, questionnaire, and 
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$elf*addressed| poitage-pald return envelope via Federal Express} the other group 
(Ss67) received the identical materials via first class maiU The survey was mailed to 
both groups on February 13, 1986, and data collection was completed on March 27, 1986^ 
The content and timing of each mailing was identical for both groups* The only 
difference between the two groups was the method of mailing. Both groups received 
the following maillngsi 

(1) An original mailing consisting of a cover letter, questionnaire, and self- 
addressed, stamped return envelope* One group was mailed Federal 
Express and the other group was mailed via first class mail, 

(2) A second mailing consisting of a postcard reminder sent via first class mail 
to all nonrespondents seven days following the initial mailing. 

(3) A third mailing consisting of a reminder message and another copy of the 
questionnaire sent via Federal Express to all nonrespondents seven days 
after the second mailing. 

Because achieving as high a response rate as possible was Important to assure the 
usefulness of the survey results to the hospitol, extensive telephone follow-up was then 
conducted* Telephone follow-up began II days after the third mailing was sent. All 
physicians who had not responded to any of the mailings were then contacted by 
telephon*) to elicit their cooperation. A response rate of 80 percent was ultimately 
achieved. 

Response rates were monitored each day to establish a day-to-day record of 
response rates for the two study samples. Comparison of response rates using Chi- 
square tests were conducted to test for differences at strategic points In the study. 
Results ware also examined to compare the amount of time required to obtain given 
levels of response rates for the tv/o samples, and to compare the cost of using Federal 
Express versus first class mail. 
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RESULTS 



The results are discussed in three subsections according to the hypotheses 
outHned in the method* These sections are as followsi 

L Effects of Federal Express mail on response rate, 
ih Speed of response using Federal Express mail. 
III. Cost of using Federal Express mail. 

Within each subsection, results from the Federal Express and first class mail 
treatments ore discussed by looking at the overall results, and, where relevanti at 
strategic points during the data collection phase. Chi-square and t-tests were used to 
assess the effects of the Federal Express mailing. Where significant differences 
(p<,05) were found, they are noted. 

I. Effacts of Federal Expr^ Moil on Re^onsa Rate 

A total of lOS of the 132 surveys mailed were completed resulting in an overall 
response rate of 80 percent. Table I shows the comparfson of response rates of the 
Federal Express group and the first class mail group at three points in timei 

(1) After each group received the initial mailing and a postcard follow-up 
reminder, 

(2) At the conclusion of mail follow-up procedures, and 

(3) At the conclusion of the study. 
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TABLE I 



Comporiions of Hm^on$m Rote Uiing Federal Expr^s 
and Fii^t Class Mail at Selectad Points in Time 



Response Rate 



Federal EKpress First Class Mail 
Response Rate Response Rate 



Selected Time % % 



After initia! maiUng and post card 

follow-up* 5Zj* 34* 

Conclusion of mail follow-up procedures 62 49 

Conclusion of study 85 75 



* x2 ^ 4.34, p < .05 



Following the initial mailing and the first follow-up reminder, the Federal 
Express group response rate was significantly higher (X^ ^ 4,34_ p ^ ,0S) than the 
regular first class mall group. At this point in time, 54 percent of the Federal Express 
mail group had completed and returned the survey forrn. In cDmparisonj only 34 
percent of the regular first class mail group had returned their completed survey. 

The response rates of the two groups were not significantly different at the 
conclusion of mail follow-up procedures or at the conclusion of the study. At the 
conclusion of mail foIIow-up» the response rate for the Federal Express group was 62 
percent compared with 49 percent for the first class mail group. At the conclusion of 
the 3tudy which included extensive telephone follow-up in addition to mail follow-up 
reminders, the response rate for the Federal Express group was 85 percent compared 
with 75 percent for the first class mail group. 
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lU Spe^ of Re^onse Using Federal Expr^ Mail 



To compare the apaed of response using Federal Express and first class mail, the 
mean number of days It took respondents to return their surveys was calcylgted at 
points in time when selected levels of response rote had been achieved* The results of 
these comparisons ore shown In Table 2* 

TABLE 2 



Comparisons of Speed of R^ponse Using Federal Expr^ and 
First Class Mall at Selected Levels of Re^onM Rate 





To Achieve 

a 25% 
Response 
Rate 


To Achieve 

a 50% 
Response 
Rote * 


To Achieve 

a 75% 
Response 
Rate 


Federal Express Mail 


x^6M days 


x^7,56 days 


Km 1 3*66 days 


First Class Moll 


x^6,4! days 


Km \ 1.82 days 


Km20.00 days 



* t(38)^3.55, (p< *0I) 
i(98)^2*66, (p< *0I) 



As shown In Table 2, there was no difference in the average speed of response at 
the 25 percent response rate level* However, significant differences between the 
groups occured at the SO and 75 percent levels of response, with Federal Express 
resulting in faster responses. 

Figure I shows the dally response rates for both groups. The figure shows that 
the Federal Express group took fewer days to achieve given levels of response rate 
than did the first class mail group. For example, the Federal Express group attained a 
SO percent response rate in II days, while It took 29 days for the first class mall group 
to achieve a 50 percent response rate. 
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FIGURE 1 

DAI LY RESPONSE RATES 

FOR 

EXPRESS AND REGULAR MAIL 




III. Cost of Using Fe^rol Expr^ Mail 



To compare the cost of using Federal Express versus first class mail, total cost 
for each group was calculated at the conclusion of the studyj an average cost per 
respondent was also calculated. Table 3 shows the average costs per completed survey 
for each group. The overage cost per survey in the Federal Express mall group was 
significantly higher than the average cost for the first class mail group. 



TABLE 3 

CofTiparlson of Federal Express and First Class Mall Coricernlng Cost 



Group 


Number of 
Completes 


Total Costs 


Average Cost 
Per Survey * 


Express Mail 
First Class Mail 


55 
50 


$1,489.19 
$1,081.47 


$27.07 
$21.63 


•i (103) = 2.71, (p<.OI) 


DISCUSSION 







Use of an express mail service can be an effective technique in increasing 
response rates to mail surveys. Express mail not only increases mail response rates 
but also achieves responses significantly faster than regular first class maih The use 
of Federal Express in this study significantly increased the response rate for a period 
of seven consecutive days as shown In Table 4 which contains the results of Chl-square 
tests conducted to compare the daily response rates of the two groups* 



TABLE # 
to Comparm Daily Re^ot^ RaM 



Date 



1/13/ - - 

2/14 - ^ 

2/lJ - 

2/16 « 

2/1^ .4775 ,4Hfi 

Z/IS ,2f05 .Siff 

2/lf 2.1214 A^33 

2/20 2.0361 ,1535 

2/21 3.7461 ,0529 

2/22 3.7463 ,052? 

2/23 3.7463 .0523 

2/24 5.1345 .0235* 

2/25 4.3407 .0372* 

2/26 5. Of 65 .0240* 

2/27 4.3346 .0373* 

2/21 4.3366 .0373* 

3/1 4.3366 ,0373* 

3/2 4.3366 .0373* 

3/3 2.4474 .1177 

3/4 l.f3fi .1637 

3/5 1.5077 ,2195 

3/6 l.i766 .I5f7 

3/7 1.5476 .2134 

3/i 1.5410 ,2134 

3/f 1.54i0 ,2134 

3/10 3. If Si ,073i 

3/11 3.1f6p ,0731 

3/12 3.1f6f ,0738 

3/13 3.9534 .0468* 

3/14 3.3713 .0661 

3/15 3.37i3 ,0661 

3/16 3.3783 .0661 

3/17 J.37i3 . 0661 

3/ia 3.37S3 .0661 

3/lf 2.S510 .0913 

3/20 1.4145 ,2343 

3/21 1.4145 .2343 

3/22 1,4145 .2343 

3/23 1,4145 .2343 

3/24 ,2447 .6209 

3/25 ,5255 .4615 

3/26 .§915 ,3451 

3/27 1.455S ,2276 

• p<.05 
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Federal Express was used at two times during this study. In addition to the 
initial mailing of one group, Federal E?cpres3 was used for a follow-up mailing sent to 
both groups. As shown in Figure 2, there were increases in response approximately six 
to seven days after both of these express mailings were done. The data suggest that 
the effect of Federal Express works best if used once at the beginning of the study, 
rather than as a follow-up technique* 



FIGU^ 2 

DAILY RESPONSE RATES 
FOR 

EXPRESS AND REGULAR MAIL 

*** T 




DATES 



2/13 ^ Initial mailing (letter and questionnaire sent Federal Express to half and 
first class to half) 

2/19 = Second mailing (postcard sent first class) 

2/25 s Third mailing (reminder and questionnaire sent Federal Express) 
3/7 m Start of telephone follow»up 
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The fact that extensive lelephone fol low-up was utilized to achieve a relatively 
high response rate in this study makes it difficult to assess what effect express mail 
would have in a study which used only mail techniques* Had telephone follow-up not 
been used, final response rate differences between groups might hove been greater, 
but the overall study response rate would have decreased and the risk of nonresponse 
bias would have Increased. 

Spaed of response was increased using Federal Express, Federal Express 
significantly reduced the average number of days It took respondents to complete the 
survey at the 50 and 75 percent levels of response* Certainly if speed Is a factor when 
considering mailing technlquesj Federal Express can be an effective technique to 
shorten the timeframe for completing data collection* 

As might be expected, the cost of Federal Express is significantly higher than 
using first class mall. Researchers will want to weigh this factor against the speed 
and response rate Increases associated with using Federal Express, Certainly tf data 
are needed quicklyi Federal Express should be considered* 

The population in this study Is also of Interest in that doctors are usually 
considered a difficult population to survey* By utlllmrig different techniques for 
mailing and follow-upi this study shows that difficult populations are reachable and 
that high response rates can be achieved* 

In summaryi using Federal Express as a response stimulator in the initial mailing, 
combined with a mixture of different types of follow-up techniques, can result in 
faster data collection and higher response rates than first class mail when surveying 
difficult populations such as physicians. Although cost Is significantly higher, the 
researcher must consider the increased cost in light of other considerations such as 
time available, need for high response rate, and difficulty of obtaining cooperation 
from a given population to determine If the increased costs are worthwhile. 
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Researchers now have a number of new techniques which they can add to their 
arsenal of tactics to not only generate high response rates but also to achieve those 
rates quickly. L'^klng ahead to the future^ current legislation Is being consir' ired 
which may restrict the use of the telephone as d method of data collectiorij and 
which may necessitate an increased reliance on mail surveys as a method of data 
collection. Use of new techniques such as express mail in conjunction with mail 
surveys has been shown to produce favorable results. Hopefully, creative methods 
of data collection utilizing these new techniques will be continualiy tested, allowing 
us to better cope with the problems of information gathering in the future. 
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